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Abstract.  We  consider  a  two-dimensional  diffusion  process  Z(t)  « 
[Z^(t)fZ2(t)]  that  lives  in  the  half  strip  (0  <.  <.  1»  0  <  Z2  <  •}.  On 

the  interior  of  this  state  space,  Z  behaves  like  a  standard  Brownian 
motion  (lndpendent  components  with  zero  drift  and  unit  variance),  and  there 
is  instantaneous  reflection  at  the  boundary.  The  reflection  is  in  a 
direction  normal  to  the  boundary  at  *  1  and  Z2  a  0,  but  at  Z^  a  0 

the  reflection  is  at  an  angle  0  below  the  normal  (0  <  0  <  n/Z). 

This  process  Z  is  shown  to  arise  as  the  diffusion  limit  of  a  certain 
tandem  storage  or  queueing  system.  It  is  shown  that  Z(t)  has  a 
non-defective  limit  distribution  F  as  t  •,  and  the  marginal 
distributions  of  F  are  computed  explicitly.  The  marginal  limit 
distribution  for  Zj  is  uniform  (this  result  is  essentially  trivial), 
but  that  for  Z 2  is  much  more  complicated. 

Key  Words  and  Phrases.  Tandem  Queues,  Storage  Theory, 

Wiener- Hop f  Technique,  Reflected  Brownian  Notion. 
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Stanford  University 
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Bell  Laboratories 


1.  Introduction  and  Summary 

This  paper  is  concerned  with  approximate  analysis  of  a  certain 

discrete-time  storage  process.  The  physical  system  giving  rise  to 

this  two-dimensional  process  is  pictured  in  Figure  1  below.  It  consists  of 

a  buffer  (or  dam  or  reservoir)  having  finite  capacity  b,  followed  by 

another  buffer  having  infinite  capacity.  Ve  denote  by  S1  and  S2  the 

contents  of  the  finite  buffer  and  the  infinite  buffer  respectively  at  time 

t  *  0,  1,  ...  .  Imposing  very  particular  assumptions  on  the  input  process 

to  the  first  buffer t  the  transfer  process  between  buffers,  and  the  output 

process  from  the  second  buffer,  we  stud|y  here  the  approximate  behavior  of 

the  storage  process  =  (51,  S2)  as  b  t  •.  To  be  more  specific,  let  us 

#  #  # 

define  a  continuous-time  process  S  (t)  =  [Sj(t),  S2<t)]  by  setting 

(1.1)  S*(t)  sis1  ,  and  s!(t)  s  S2  , 

for  t  J>  0,  where  [x]  denotes  the  integer  part  of  x  (the  largest 
integer  less  than  or  equal  to  x).  There  is  a  two-dimensional  diffusion 
process  Z  such  that  $*  converges  weakly  to  Z  as  b  ♦  «*,  and  we  would 
like  to  determine  the  steady-state  behavior  of  Z. 
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At  the  boundary,  Z  reflects  Instantaneously.  On  the  sides  Zj  =  1  and 
Z2  sO  we  have  what  is  called  nortsal  reflection.  On  the  side  Z^  =  0 
there  is  oblique  reflection  in  the  direction  pictured  in  Figure  2,  where 
a  =  1/o  and  is  the  variance  parameter  introduced  in  Figure  1.  The 
precise  Meaning  of  this  boundary  behavior  will  be  explained  in  $3.  In  $4 
it  will  be  shown  that  P{Z(t)  £  y)  *■  F(y)  as  t  ♦  •,  where  F  is  a  non¬ 
defective  distrlbtion  on  the  strip  E,  and  this  limit  distribution  (or 
steady-state  distribution)  will  be  shown  to  satisfy  a 


Figure  2.  State  Space  E  and  Angles  of  Reflection 
for  the  Diffusion  Limit  Z 

certain  adjoint  relation.  Using  this  adjoint  relation  and  Wiener -Hopf 
techniques,  we  calculate  the  marginal  distributions  of  F  in  §5. 

The  marginal  steady-state  distribution  of  Zt  is  uniform,  which 
follows  immediately  from  the  fact  that  Zj  is  a  one -dimensional  standard 
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Brownian  notion  constrained  to  [0,1]  by  reflecting  barriers.  But  the 
Marginal  steady -state  distribution  of 

C(?)  s  F(1,{)  ,  u  >  0  , 

is  Muoh  More  coeplex.  Let 

(1.2)  Ci*r(i  - f)/r(i  -f£)  r(|)  , 

(1.3)  p(u)  =  e'6u(1  -  e‘*u)"2®/*  ,  u  >  0  , 

where  6  =  tan"'  a  as  in  Figure  2,  and  r ( - )  is  the  standard  gamma 
function 

T(s)  s  /  e‘*  t4-1  dt  ,  s  >  0  . 

0 

It  will  be  shown  that  cp(u)  is  a  probability  density  function  on  (0,-) 
with  Mean  1/a,  and  that  this  distribution  describes  the  asymptotic 
behavior  of  a  certain  increasing  process  associated  with  the  boundary 
ly  s  0.  Our  main  result  is  the  following. 

(1.4)  Theorem.  G(d{)  *  g(g)d(  where  g(()  «  a  /**  cp(u)du. 

C 

From  (1.4)  it  follows  that  the  steady-state  Marginal  distribution  G  has 
Laplace  transfom 


transfer  between  the  two  buffers.  As  a  convenient  normalization  we  can 
0  2  2 

assume  that  Var(ut)  =  1,  and  then  we  set  o  =  Var(u^).  These  notational 
conventions  are  also  displayed  in  Figure  1.  For  simplicity  we  take 
s  ^  s  0,  meaning  that  both  buffers  are  initially  empty. 

The  content  process  for  the  finite  buffer  is  now  defined  inductively 


(2.3) 


lt  0  i  sJ.i  * u?  -  4 


sJ-i  *  u?  -  »t  •  lf  0  i  sJ.i  *  u?  -  » 


st.i 


for  t  *  1,  2,  ...  .  This  is  of  course  the  standard  construction  for  the 
content  process  of  a  finite  dam  in  discrete  time  [6].  Actual  input  to  the 
dam  during  period  t  may  be  less  than  the  full  potential  input 
because  of  the  capacity  restriction,  and  actual  output  may  similarly  be 
less  than  the  full  potential  output  because  of  the  restriction 
S.|  2i  0.  Defining 


(2.4) 


(2.5) 


<  ■  A  -  A 


-■  tsJ.i  *  <  ■  m* 


(2.0 


»J .  [s’.,  ♦  x’r  , 


we  observe  that  y”  represents  lost  potential  input  to  the  finite  buffer 
during  period  t,  and  represents  lost  potential  output  from  the  finite 
buffer,  which  amounts  to  lost  potential  transfer  between  the  two  buffers 


buffer,  which  amounts  to  lost  potential  transfer  between  the  two  buffers 
pictured  in  Figure  1.  That  is,  actual  input  to  the  finite  buffer  during 
period  t  is  u®-y®,  actual  transfer  between  the  two  buffers  during  period 
t  is  u*-y^|,  and  (2.3)  is  equivalent  to  (2.4)-( 2.6)  plus 

(2.7)  s  sj  .,  ♦  xj  ♦  y\  -  y*  » 

for  t  =  1,  2,  ....  Having  established  that  the  actual  input  to  the 

1  1 

infinite  buffer  during  period  t  is  -  y^,  we  can  define  the  content 
process  for  the  infinite  buffer  inductively  by  setting 

St-1  +  ut  "  yt  "  ut  lf  St-1  +  ut  ‘  yt‘  ut  -  0 

(2.8)  S \  s 

0  otherwise 

for  t  :  1,  2,  ...  .  Defining 

(2.»>  *\  5  ut  '  ut  ’ 

(2.10)  y\  *  [S*_,  ♦  -  yj)’, 

2 

we  see  that  yt  represents  lost  potential  output  from  the  infinite  buffer 

2  2 

during  period  t.  That  is,  actual  output  during  period  t  is  u^-y^,  and 
(2.8)  is  equivalent  to  (2.9)-(2.10)  plus 

(2.11)  S*  =  S*  +  x\  -  yj  +  y\  ,  for  t  *  1,  2,  ...  . 

To  derive  an  equivalent  and  very  useful  characterization  of  the 
storage  process  S,  let  us  define  the  cumulative  quantities 


(2.13)  Yt  =  y1  +  *•*  +  yt  »  for  t  =  1»  2»  •••  and  k  =  °»  1*  2, 

with  Xq  =  Yq  =  0.  By  summing  (2.7)  and  (2.11)  over  periods  1,  ...»  t  we 
have 

U.1»>  - Y?  - 

(2.15)  St  *  *t  *  A  *  Vt 
for  t  *  0,  1,  ...  .  By  construction  we  have 

(2.16)  0  <  S*  <  b  and  S2  >  0  for  t  =  0,  1,  ... 

and  one  can  easily  verify  that 

(2.17)  s’ayJ  .  (b-sj)  Ay£  =  S^ayJ  =  0  for  t  =  1,  2 . 

where  AY^  =  y£  -  y£_j  =  y£.  Obviously  (2.16)  and  (2.17)  together  require 

that  AY^  s  0  except  when  =0,  that  AY®  =  0  except  when  S*  =  b,  and 

that  AY^  s  0  except  when  S2  =  0. 

Ve  now  define  the  normalized  continuous 'time  storage  process 
S*(t)  m  [S*(t),  S*3  by  applying  to  S  the  transformation  (1.1).  In  a 
similar  vein,  let  X#(t)  s  [X*(t)  jX^t)]  and  Y#(t)  =  [YQ(t),Yj(t),Y.j(t)] 
be  defined  by 

(2.18)  x!(t)  .  £  X1  ?  ,  X*  =  4-  X2  ,  , 

1  ¥  [b2t]  2  ^  Cb2t] 
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(2.19)  YU<t)=T7Y°?  ,  Y*(t)=iv1-  ,  Y*(t)  = -X-  Y2  , 

0  F  [b2t]  1  F  [b2t]  2  ^  [b2t] 


for  t  2  0.  Obviously  X*  is  right-continuous  with  left-hand  limits 
(RCLL),  and  from  (2.7),  (2.11),  and  (2.14)-(2.17)  it  follows  that  Y*  and 
S*  have  the  following  properties: 

(2.20)  is  RCLL  and  non -decreasing  with  Y^(0)  =0  (k  =  0,  1,  2), 


(2.21)  S*(t)  =  X*(t)  +  Y*(t)  -  Y^(t)  , 


(2.22)  S2(t)  =  X2(t)  +  Y2(t)  -  aY^t)  where  a  s -1  , 


(2.23)  O^S^tMl  and  S2(t)  >  0  , 


t  t  t  , 

(2.24)  /  S*(u)  dY*(u)  =  /  [1-S*(u))  dYj(u)  =  /  S*(u)  dY*(u)  =  0 


for  all  t  >  0,  where  the  integrals  in  (2.24)  are  defined  path-by-path  in 

the  Lebesgue-Stielt jes  sense.  (These  integrals  do  not  exist  in  the 

*  * 

Riemann-Stielt jes  sense  because,  for  example,  and  Y^  jump 
simultaneously.) 

We  have  arrived  at  (2.20)-(2.24)  as  characterizations  of  processes 
constructed  previously,  but  these  relationships  can  actually  be  used  to 
define  Y*  and  S*  in  terms  of  X*.  That  is,  with  X*  defined  in  terms 
of  the  primitive  sequences  {u£>  via  (2.4),  (2.9),  (2.12)  and  (2.18), 
there  exists  a  unique  pair  of  processes  (Y*,S*)  that  jointly  satisfy 

(2.20)  -(2.24).  Thus  (2.20)-(2.24)  implicitly  define  an  operator  which  maps 
X*  into  (Y*,$*).  In  the  next  section  we  use  relationships  analagous  to 

(2.20) -(2.24)  to  define  a  pair  of  processes  (U,Z)  in  terms  of  a 
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two-dimensional  standard  Brownian  motion  W.  Donsker's  Theorem  [2]  tells 


I 

ml 


us  that  X*  converges  weakly  to  W  as  b  ♦  •,  and  then  the  continuous 
mapping  theorem  [2]  can  be  used  to  show  that 

(X*,  Y*,  S*)  =*  (W,U,Z)  as  b  ♦  •  , 


where  ==>  denotes  weak  convergence  in  a  seven -fold  product  space.  We 
shall  not  go  further  into  the  convergence  argument  here,  referring  the 
interested  reader  to  Wenocur  [7].  The  remainder  of  this  paper  is  devoted 
to  construction  and  characterization  of  the  diffusion  limit  Z. 


3.  The  Limiting  Diffusion  Process 

Let  W(t)  s  [W^t),  Wjtt)]  be  a  two-dimensional  standard  Brownian 
motion  (independent  components  with  zero  shift  and  unit  variance). 
Defining  a  =  1 /a  as  in  (2.22),  we  wish  to  construct  processes 


U(t)  =  [UQ(t),  11,(0,  u2(t)] 

satisfy 


‘1 

■  - 

(3.1) 

Uk  is  continuous  and 

(3.2) 

Z,(t)  »  wt(t) 

+  U^t) 

1 

(3.3) 

z2(t)  »  w2(t) 

+  U2(t) 

(3.4) 

0  <  Z,(t)  <  1 

and 

'  1 

4 


and  Z(t)  =  [Zj(t),Z2(t)]  which  jointly 
non -decreasing  with  Uk(0)  =  0  (k  «  0,1,2,), 

-  Vt)  » 

-  aU,(t)  , 

Z2(t)  >  0  , 
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t  t  t 

(3.5)  /  Z.(s)  dU.(s)  =  /  [1-Z, <»)]  dUn(s)  =  /  Z,(s)  dU,(s)  =  0 

o’  1  0  1  u  5  c  c 

for  t  0.  Condition  (3.4)  says  that  Z  lives  within  the  semi-infinite 
strip  £  pictured  in  Figure  2.  Obviously  (3*5)  requires  that  U-j 
increase  only  when  Zj  =  0,  that  Uq  increase  only  when  =  1,  and  that 
increase  only  when  Z?  =  0.  Conditions  (3.2)  and  (3.3)  determine  the 
direction  in  which  Z  is  driven  upon  hitting  the  boundary  of  £.  On  each 
of  the  three  boundary  surfaces  we  have  reflection  in  the  (constant) 
direction  pictured  in  Figure  2  above. 

For  each  (continuous)  sample  path  W  there  is  in  fact  a  unique  pair 
of  sample  paths  (U,Z)  satisfying  (3.1) >(3.5).  The  argument  goes  as 
follows.  If  we  delete  all  mention  of  and  Z?  In  (3.1)-(3.5),  the 
remaining  conditions  are  those  which  define  l\  as  a  one-dimensional 
standard  Brownian  motion  restricted  to  [0,1]  by  reflecting  barriers; 
and  UQ  are  increasing  processes  (local  time  processes)  associated  with 
the  lower  boundary  and  upper  boundary  respectively.  For  a  construction  of 
Uq  and  U^  in  terms  of  see  55  of  [5],  With  Uq  and  U1 
determined,  one  may  argue  as  in  $2  of  [3]  that  the  remaining  requirements 
of  (3.1)-(3.5)  are  uniquely  satisfied  by  taking 

(3.6)  U,(t)  =  sup  [>W,(s)  +  aU.(s)]+  ,  t  >  0  . 

0  <  s  £  t  ~ 

This  construction  of  (U,Z)  from  W  is  valid  for  any  staring  state  W(0) 
=  (x^,x2)  «  £.  Holding  <W(t)  -  W(0),  t  ^  0}  fixed,  it  can  be  verified 
that 
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f  W  l.l  W  >  ■  <1  ■  I 

i 


s 

s 


(3.7)  Z^(t)  and  Z2<t)  are  non -decreasing  functions  of  both 
and  Xj  for  all  t  £  0. 

Using  an  argument  like  that  in  |2  of  [3],  it  follows  that  Z  is  a  Markov 
process ,  and  we  shall  denote  by  Px(» )  the  distribution  on  the  path 
space  of  Z  corresponding  to  initial  state  Z(0)  *  f(0)  *  x.  From  (3.6)  we 
have  that 

(3.8)  Ft(x,y)  =  Px(Z(t)  <  y)  is  non -Increasing  in  both  x^  and 
x2  for  all  t  0  and  y  c  £. 


•t. 

1 

g 


w 


The  process  U  satisfying  (3.1)-(3.S)  is  non-anticipating  with 
respect  to  W.  Thus  Z  is  a  continuous  semimart ingale ,  using  the 
filtration  generated  by  Wy  and  we  can  develop  its  analytical  theory  using 
the  multidimensional  Ito  Formula.  For  functions  f  :  R*  ♦  R  that  are 
twice  continuously  dlfferentlabley  we  define  the  differential  operators 


A 


f 


°1 


and 


Defining  the  boundary  surfaces 


Z0  *  {<*iyx2)  «  Z  *  x1  *  1}  y 


and 


Z1  5  {(x1fX2)  C  I  I  X|  «  0)  y 

I2  *  (<*-|»*2)  c  £  *  x2  *  0)  y 


12 


we  observe  that  D^f  is  the  directional  derivitive  of  f  in  the 
direction  of  reflection  associated  with  Efc  (see  Figure  2).  The 
following  proposition  is  virtually  identical  to  Theorem  2  of  [3],  so  we 
shall  not  prove  it. 

(3.9)  Proposition.  If  f  :  R^  +  R  is  twice  continuously  differentiable, 
then  for  all  X  and  t  £  0 

2  t 

eXt  f(Z(t))  =  f (Z(0) )  +  l  j  eXs  f(Z(s))  d#.( s) 

k=1  0  oxk  K 

+  I*  eXs(X  +  -y  *<*<•»  <«* 

0 

2  t 

+  I  /  «  *<«•»  • 

k=0  0 

Here  the  Integrals  involving  dW*  are  of  Ito  type,  while  those  involving 
dU|(  are  defined  path  by  path  in  the  Rlemann-Stieltjes  sense. 

(3.10)  Proposition.  Ex[UQ(t)]  ~  j  t,  E^U^t)]  and  ~  f  * 

as  t  ♦  •  (x  €  £). 

Proof.  Set  X  =  0  and  ffxjyXg)  =  x^  in  (3.9).  Then  (X*A)f  *  0, 

-DqT  =  D^f  *  1,  and  O^f  =  0.  Moreover,  the  Ito  integrals  have  zero  expec 
tatlon,  because  their  integrands  are  bounded.  Thus,  taking  Ex  of  both 
sides,  we  obtain 

(3.11)  Ex[Z1(t)J  *  X1  +  ExfUl<t)]  -  Ex[U0(t)]  . 

Similarly,  by  taking  X  a  0  and  f(x)  ix^  w  have 


Taking  Ex  of  both  sides  In  (3.16) ,  dividing  by  t  and  letting  t  • 
gives  (3.14),  thus  completing  the  proof. 

(3.17)  Proposition.  Let  X  >  0,  a  e  (0,  s/2)  and  p  >  0  be  constants, 
let  f(x)  *  cos(a(1-x^))  expfpxj),  and  define  M(t)  =  exp(Xt)  f(Z(t))f 

t  _>  0.  If  the  constants  X,  a,  p  simultaneously  satisfy 

(3.18)  X  ♦  \  (p2-a2)  *  0  , 

(3.19)  a  sin  a  -  ap  cos  a  =  0  , 

then  the  stopped  process  (M(t  *  T),  t  >0}  Is  a  supermartingale,  where 

(3.20)  T  =  lnf(t  >  0  t  Z2(t)  «  0)  . 

Remark.  The  stopped  process  Is  In  fact  a  martingale,  but  we  shall  only 
need  the  weaker  property,  and  It  Is  slightly  easier  to  prove. 

Proof.  First  observe  that 

(3.21)  0Qf(1,x2)  =  0  , 

regardless  of  how  X,  a  and  p  are  chosen,  and  that  (3.18)  and  (3.19) 
Imply 

(3.22)  (X  +  \  A)  f(x,,  x2)  *  0  , 

and 


(3.23) 


D.f(0, x.)  *  0 


respectively.  Combining  (3.21)-(3.23)  with  the  fact  that  ^(T)  =  0,  we 
see  that  all  terms  on  the  right  side  of  (3.9)  except  for  the  Ito  Integrals 
are  zero,  provided  t  £  T.  Thus  {M(t  a  T)}  is  a  local  martingale.  But 
f  Is  a  positive  function,  hence  H  is  a  positive  process,  and  a  positive 
local  martingale  is  a  supermartingale  (Fatou's  Lemma).  This  completes  the 
proof. 

(3.24)  Propositon.  EX(T)  <  •  for  all  x  e  E,  where  (3.20)  defines  T. 

Proof.  First  we  show  that  there  exist  constants  X  >  0,  a  e  (0,  x/2)  and 
0  >  0  satisfying  (3.18)  and  (3.19).  Obviously  (3.19)  is  equivalent  to 

(3.25)  0  =  |  tan  a  . 

a 

Substituting  this  into  (3.19),  we  arrive  at  the  requirement  that 

(3.26)  4(a)  2  a*( 1  -  a”*  tan*  a)  =  2\  . 

It  can  be  verified  that  4(0)  =  0,  4 * (0)  >  0,  and  4(a)  -®  as  at  x/2, 

so  there  exists  a  e  (0,  x/2)  satisfying  (3.26)  if  X  >  0  is  chosen  small 
enough.  Choosing  0  according  to  (3.25),  we  then  have  a  triple  (X,a,0) 
satisfying  the  hypotheses  of  Proposition  (3.17).  Thus  M(t  a  T)  is  a 
supermartingale,  meaning  that  Ex[M(0)]  E[M(t  a  T)],  which  is 
equivalent  to 

(3.27)  f(x)  >  Ex[eX(tAT)  f(Z(t  a  T)))  >  Ex[eX(tAT)]  cos  a  . 

Letting  t  t  •  in  (3.27)  gives 
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(3.28) 


Ex(eXT)  <  f(x)/cos  a 
which  of  course  implies  EX(T)  <  •  as  desired. 


4.  The  Analytical  Problem 

Hereafter  it  will  be  assumed  that  f(0)  =  Z(0)  =  0y  and  the  symbols 
P(»)  and  E(»)  will  be  understood  to  mean  P()(*)  and  Eq(*) 
respectively.  Similarly,  recalling  the  notation  Ft(x,y)  s  Px(Z(t)  <  y), 
let  us  agree  to  write 

(4.1)  Ft(y)  5  P<Z(t)  <  y)  *  Ft(0,y)  . 

Because  the  origin  is  the  least  element  of  our  strip  £  (under  the  usual 
partial  ordering),  it  follows  from  the  monotonicity  property  (3.8)  that 
Z(t)  is  stochastically  Increasing  in  t,  meaning  that  F^(y)  is  a 
non-increasing  function  of  t  for  each  ye  I.  Consequently, 

(4.2)  F(y)  5  lim  F.(y) 

exists,  and  it  follows  from  Proposition  (3.24)  that  F  must  furthermore  be 
a  non-defective  distribution  function.  (Xir  objective  is  to  compute  the 
marginal  distribution 

(4.3)  C(?)sF(1,5)x  lim  P{Z?(t)  <  O  ,  C>0  . 

t  ♦  • 

Incidentally,  there  is  an  elegant  coupling  argument  which  shows  that 
Ft(x,y)  ♦  F(y)  as  t  •  for  all  starting  states  x  e  E,  but  we  shall 
have  no  need  for  this  fact.  (The  key  observation  is  that  if  two  sample 


paths  of  W  have  different  starting  states  but  Identical  increments,  then 
the  corresponding  paths  of  Z  will  interesect  at  some  finite  time  T  and 
be  identical  thereafter.) 

We  now  want  to  derive  an  analytical  characterization  of  the 
steady-state  distribution  F.  A  useful  first  step  is  to  define  the 
functions 

(4.4)  Mt(„)  .  f  E[/‘  1,Vs)<u)  dU,(.)]  ,  t  >  0  . 

Obviously,  H^(*)  is  increasing  with  H^(»)  =  2E[Uj(t)]/t,  which  one 
can  easily  show  to  be  finite.  Proposition  (3.10)  shows  that  Ht(<»)  +  1 
as  t  ♦ 

(4.5)  Proposition.  H  as  t  ♦  •,  where  H  is  a  distribution 

function  on  [0,«O  with 

-  •  4 

(4.6)  /  u  H(du)  «  /  [1  -  H(u)  ]  du  =  ^  . 

0  0  a 

Furthermore, 

,5 

(4.7)  C ({)  »  a  /  [1  -  H(u)]du  . 

0 


Proof.  It  will  be  useful  to  define  the  distribution  functions 


Let  a  >  0  be  arbitrary,  put  Into  (3.9)  the  test  function  f(x<|,X2)  = 
exp(-ox2>»  and  take  E(*)  of  both  sides.  The  Ito  integrals  have  zero 
expectation  (integrands  are  bounded),  Dgf  =  0,  D^f  =  aaf,  D->f(x.p0)  =  -a, 
and  Af  =  o2f,  so  we  have 


t  -«Z9(s) 

+  aoE[/  e  2  dlUs)]  -  o£[U  (t))  . 
0 


Set  G*(a)  2  frn  i  e-®5  G.  (d£ ) ,  and  let  other  Laplace  transforms  be 
t  LOf*J  v 

denoted  similarly.  Since  <*  =*  G,  the  continuity  theorem  gives 

.  t  -oZ-(s)  i  t  -aZ-(s) 

(4.10)  TE[/e  ds]=T/  Et«  1  ds 

c  0  0 


=  i  /  G*(a)  ds  ♦  G*(a) 

V  A  3 


as  t  • 


Of  course 


(4.11)  I  E[Uz(t)]  -*•  j  a  as  t  *►  • 

by  (3.10),  and  a  monotone  class  argument  gives 

(4.12)  ±  E [J*  e’oZ2(s)  >  e-«5  ^(d*)  =  ^  H*(«)  . 

Dividing  (4.9)  through  by  t,  letting  t  ♦  •,  and  using  (4.10)-(4.13),  we 
obtain  H*(a)  ♦  1  -  a  G#(o)/a  as  t  Thus  =»>  H,  where  H  is  an 

increasing  function  whose  Laplace  transform  is  related  to  that  of  G  via 
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(4.13) 


C  <«)  ■  i  [1  -  H  (a)]  . 

Since  G  is  a  distribution  function  it  follows  fro*  (4.13)  that  H  is 
also  a  distribution  function  with  mean  given  by  (4.6).  Finally,  (4.13)  is 
the  transform  version  of  (4.7),  so  the  proof  is  complete. 

For  the  next  proposition,  we  want  to  insert  in  the  Ito  Formula  (3.9) 
test  functions  f  :  Z  ♦  R  such  that 

(4.14)  f  is  twice  continuously  differentiable,  with  bounded  first 
and  second-order  partials  on  E,  and  Dgf( 1  ,x2 )  = 

D2f(xi,0)  a  0. 

(4.15)  Proposition.  If  f  satisfies  (4.14)  then 

(4.16)  0  «  /  Af  (x)  F(dx)  ♦  /  0/(0, u)  H(du)  . 

I  to,-)  1 

Proof.  Set  X  a  0  in  (3.9)  and  take  E(»)  of  both  sides.  The  Ito 
integrals  have  zero  expectation  (bounded  integrands),  and  D^f ( 1 ,x2)  = 
0?f(x.,0)  a  0  by  hypothesis,  so  we  obtain 


Since  vfc  concentrates  all  of  Its  mass  on  E|<  by  (3.5),  we  can 
rewrite  (4.18)  as 


I 


(4.20)  0  =  /  Afg(x)  F(dx)  +  11  D.f(c)  v.(do)  , 

S  k=0  Ek 

and  (3.10)  shows  tht  Vq(Eq)  =  Vj(Ej)  =  1/2  and  ^(Ep)  =  a/2.  Obviously, 

(4.15)  specializes  (4.20)  to  test  functions  f  of  the  class  (4.14),  with 
H(u)  =  2v<|[0,u].  For  more  on  adjoint  relations  like  (4.20)  see  $9  of 
[4]. 

5.  The  Steady-State  Distribution 

By  putting  a  well  chosen  test  function  f  into  the  adjoint  relation 

(4.15) ,  we  can  determine  the  steady-state  boundary  distribution  H  defined 
by  (4.4M4.5).  Let 

(5.1)  4+(z)  5  f  elzu  H(du)  ,  Im(z)  >  0  , 

[0,«) 

(5.1)  4"(z)  =  /  e"lzuH(du)  ,  Im(z)  >  0  , 

L0,«») 

(5.3)  Proposition,  and  4"  are  bounded,  analytic  in  the  upper 
half-plane  and  lower-half  plane  respectively,  and  satisfy 
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1 

i 

1 


1 


(5 

Proof.  The  boundedness  and  analyticity  follow  immediately  from  the 
definitions  (5.1),  (5.2).  To  prove  (5.4),  let  z  e  R  be  arbitrary  and 
define 

f(x)  cosh  lzx2  cosh  z(l-x^)  ,  for  x  e  £  . 

It  is  easy  to  verify  that  f  satisfies  all  the  restrictions  of  (4.14), 
plus  Af  =  0,  so  (4.15)  gives  us 

(5.5)  0  =  /  O.f (0,u)  H(du)  . 

10,-c)  1 

(This  is  actually  a  pair  of  identities,  one  for  the  real  part  of  D-jf 
and  one  for  the  imaginary  part,  but  we  shall  continue  to  use  the  efficient 
notation  of  complex  variables.)  Now  direct  computation  gives 

(5.6)  Djf (0,u)  5  (j—  *  a  a“)  '«>,u) 

a  -  z  sinh  z  cosh  izu  -  aiz  cosh  z  sinh  izu 

a  -  ^  z[(sinh  z  +  ai  cosh  z)  elzu  +  (sinh  z  -  ai  cosh  z)  e"izu] 

a  j  iz[(a  cosh  z  +  1  sinh  z)  e"*zu  -  (a  cosh  z  -  i  sinh  z)  e*zu]  . 

Substituting  (5.6)  into" (5.5)  and  dividing  in  the  obvious  way  gives  the 
desired  identity  (5.4). 
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Using  the  identity  r(a)  r(1-a)  =  */sin(xa),  we  divide  (5.11)  by  (5.10)  to 
obtain 


(5.12) 


4>~(z)  sin(0-iz) 
<+(*)  =  9ln{eAz) 


Expanding  the  sines  on  the  right  side  of  (5.12),  we  find  that  (5.4)  holds 
with  (4+,4>~)  in  place  of  (♦■*■, ♦").  Furthermore,  p  is  positive  and 
integrable  on  (0,«),  so  (<l>+,<|r)  have  all  the  properties  ascribed  to 
($+,$~)  in  Proposition  (5.3). 


(5.13)  Proposition.  $+(z)  =  a|>+(z),  where  c  is  defined  by  (1.2).  Thus 
H(du)  =  cp(u)du. 

Proof.  Let  k(z)  =  4+(z)/4»+(z)  for  I »(z)  0,  k(z)  *  ♦"(z)/<T(z)  for 

Im(z)  <  0.  These  two  definitions  agree  for  real  z  because  ( ♦"*■,♦”)  and 
(4»+,<l'”)  both  satisfy  (5.4).  Recall  that  the  r  function  has  no  zeros, 
and  its  singularities  are  poles  on  the  negative  real  axis,  cf.  6.1.3  of 
Abramowltz  and  Stegun  [1].  From  this  and  the  analytlclty  of  ♦*,  4»*» 

on  their  respective  half  planes,  it  follows  that  k(z)  is  an  entire 
function  of  z.  Further, 

(5.14)  r(z+a)  zb'a/rU+b)  «•  1 

as  |  z  |  -*■«*,  z  *  -a-n  or  -b-n  (n  =  0,  1,  ...),  cf.  6.1.4  of  Abramowltz 
and  Stegun  [1).  From  (5.10)  and  (5.11)  we  then  have 

(5.15)  |**(z)|  >  y\i\UZ*l%  as  |z|  ♦  -  ,  Im(z)  >  0  , 
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(5.16)  |4»”(z) |  >y\z\U2*'*  •»  |*|  ♦  -»  I»(z)  <  0  , 

for  some  constant  y  >  0.  Since  0+  end  0"  are  bounded  in  their 
respective  half-planes,  it  follows  that 

(5.17)  |k(z)|  <  A|z|*<1“20,*)  as  |z|  ♦  -  , 

for  some  constant  A  >  0.  Since  0  <  1-20/*  <  1,  it  follows  from  (5.17) 
and  Liouville's  Theorem  that  such  an  entire  function  k(z)  is  a  constant. 
So  ♦+(z)  =  c0+(z)  for  some  c  >  0.  Of  course  0+(O)  »  1  by  definition 
(++  is  the  characteristic  function  of  a  probability  distribution),  so  it 
must  be  that  c  =  1/4»+(0),  so  (5.10)  shows  that  c  is  given  by  (1.2)  as 
claimed.  This  proves  the  first  statement  of  the  proposition,  and  the 
second  follows  from  the  continuity  theorem  for  characteristic  functions. 

The  preceeding  argument  gives  no  hint  of  the  means  originally  used  to 
calculate  p,  which  was  roughly  the  following.  First  the  right  side  of 
(5.4)  was  factored  into  products  of  zeros,  using  the  Hadamard  product 
formulas  for  the  numerator  and  denominator  Individually.  The  Individual 
factors  were  allocated  to  4>*  and  4>~  so  as  to  insure  analyticity  in  the 
upper  half-plane  and  lower  half-plane  respectively,  and  then  the  Euler 
product  for  r  was  used  to  obtain  (5.10)  and  (5.11).  Finally,  a  partial 
fraction  decomposition  and  sum  revealed  that  0+  is  the  characteristic 
function  of  the  density  p  defined  by  (1.3). 

To  obtain  the  final  formula  for  G  stated  earlier  as  Theorem  (1.4), 
one  simply  combines  (5.13)  and  (4.7).  The  equivalent  Laplace  transform 
solution  (1.5)  is  obtained  by  combining  (4.13),  (5.13)  and  (5.10). 
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and  it  Ju«ps  upon  hitting  the  boundary.  If  the  boundary  is  hit  at  a  point 
(x,1),  then  there  is  an  instantaneous  Jump  to  the  point  (x-ae  sgn  x,  1-e), 
after  which  the  Brownian  aovenent  resumes.  If  the  boundary  is  hit  at 
(x,  -1),  then  the  Jump  is  to  (x-ae  sgn  xt  -1+c).  Let  Tn  be  the  nth 
time  at  which  the  boundary  is  hit,  and  set  )(„  :  X(Tn).  We  claim  that 
(Xn>  is  a  Markov  chain,  that  it  has  a  unique  stationary  distribution,  and 
that  the  stationary  distribution  of  |Xn|  converges  weakly  to  the  boundary 
distribution  H  of  $4  as  t  +  0.  We  shall  Make  no  attempt  to  Justify  any 
of  these  claims,  hoping  that  the  symmetry  apparent  in  Figure  3  makes  them 
at  least  plausible. 

Hereafter  assume  that  the  initial  state  of  (X,Y)  is  distributed 
randomly  over  the  boundary  of  the  strip  according  to  the  stationary 
distribution  of  (Xp>.  Then  the  transition  mechanism  for  our  stationary 
Markov  chain  {X,,}  can  be  expressed  as 

<<-1>  *n+1  *  *„  '  «  *•»  *„  *  «n,1  ' 

where  is  the  Increment  of  Brownian  movement  (in  the  X  direction) 

between  consecutive  hittings  of  the  boundary.  Defining 

(6.2)  ♦e(z)  5  E[exp(iiXn)J  , 
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(6.3) 


4»e(z)  s  E[exp(ircn+1] 


9 


we  have  from  (6.1)  that 

(6.4)  4e(z)  =  4>e(z)  E(exp[iz(Xn  -  at  sgn  Xn)]}  , 

because  {Xn}  is  stationary  and  is  Independent  of  X„  (using 

the  spatial  homogeneity  of  Brownian  motion).  Next,  using  the  fact  that 

M(t)  =  exp{iz  X(t)  ♦  zY(t)>  ,  t  £  0  , 

is  a  martingale  for  arbitrary  complex  z,  one  can  easily  derive  the  formula 

(6.5)  4  (z)  *  cosh (z(1-e)) /cosh  z  . 

e 

Now  defining 

(6.6)  4*(z)  *  E[exp(iz|Xn|))  , 

(6.7)  *;(z)  *  E[exp(iz|Xj)]  , 

symmetry  and  (6.2)  give  us 

(6.8)  4e(z)  =  {  K(z)  *  7  ♦e(z) 

(6.9)  E{exp[iz(Xn  -  at  sgn  Xn)]> 

.  \  ♦;<*>  .  4  ♦;<!)  .lMt  . 

Substituting  (6.5),  (6.8)  and  (6.9)  into  (6.4)  and  simplifying,  we  obtain 


(6.10) 


cosh  z  -  cxp(-lzac)  cosh(z(1-c)) 
cosh  z  -  exp(izae)  cosh(zO-e)) 


Let  6+(z)  and  6”(z)  be  defined  in  teres  of  H  as  in  IS.  If  the 
stationary  distribution  of  |Xn|  converges  weakly  to  H  as  e  +  0,  as 
claimed  earlier,  then  of  course  6+(z)  +  4*(z)  and  ♦“(z)  ♦  $~(z)  as 

c  c  c 

e  +  0.  Assuming  the  weak  convergence,  we  may  then  let  e  10  in  (6.10)  to 
obtain  (5.4). 


References 


[1]  N.  Abramowltz  and  I.  A.  Stegun  (1964),  Handbook  of  Mathematical 

Functions,  U.S.  Government  Printing  Office,  Wasington,  D.C. 

[2]  P.  Billingsley  (1968),  Convergence  of  Probability  Measures,  Wiley, 
New  York. 

[3]  3.H.  Harrison  and  H.I.  Reiman  (1981),  Reflected  Brownian  Notion  on  an 
Qrthant,  Ann.  Prob.,  Vol.  9,  302-308. 

[4]  3.H.  Harrison  and  H.I.  Reiman  (1981),  On  the  Distribution  of 

Mulitdimensional  Reflected  Brownian  Notion,  SIAN  3.  Appl.  Nath., 
Vol.  41,  345-361. 

[5]  3.N.  Harrison  and  N.I.  Taksar  (1982),  Instantaneous  Control  of 

Brownian  Notion,  Nath.  Ops.  Rsch.,  to  appear. 

[6]  P.A.P.  Horan  (1959),  The  Theory  of  Storage,  Hethuen,  London. 

[7]  N.  Wenocur  (forthcoming),  A  Production  Network  Nodel  and  Its 
Diffusion  Approximation,  Ph.D.  Dissertaion,  Department  of  Statistics, 
Stanford  University. 


ABSTRACT  -  Report  Number  204 


<: ;  .  - 

We  consider  a  two-dimensional  diffusion  process  Z(t)  = 
[t^(t)flsj(t)]  that  lives  in  the  half  strip  {0  <_  1,  0  ^  ^  <  *}.  On 

the  Interior  of  this  state  space,  Z  behaves  like  a  standard  Brownian 
motion  (indpendent  components  with  zero  drift  and  unit  variance),  and  there 
is  Instantaneous  reflection  at  the  boundary.  The  reflection  is  in  a 
direction  normal  to  the  boundary  at  Z.  »  1  and  A  =  0,  but  at  X.  ■  0 
the  reflection  is  at  an  angle  W}  below  the  normal  (0  <  )B  <  Xf 2 ). 

This  process  Z  is  shown  to  arise  as  the  diffusion  limit  of  a  certain 
tandem  storage  or  queueing  system.  It  is  shown  that  Z(t)  has  a 
non-defective  limit  distribution  F  as  t  ♦  <*,_  and  the  marginal 
distributions  of 
distribution  for 
but  that  for  Zj 


.1  l/v  t/'lsr *  \f 

F  are  computed  explicitly.  The  marginal  limit 
if  is  uniform  (this  result  is  essentially  trivial), 
is  much  more  complicated. 
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